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INCREMENTAL INTERLACE INTERPOLATION FOR TEXTURE 



MORPHING 



FIELD OF THE INVENTION 

This invention relates to computer graphics, and more particularly, to 
techniques for metamorphosing ("morphing") a texture map from a source texture 
to a target texture. 

BACKGROUND AND SUMMARY OF THE INVENTION 

In graphics, metamorphosis, or morphing, is the process of gradually changing 
.a source object through intermediate objects into a target object. For example, a 
-person's face can be morphed into another person's face, an animal can be 
" morphed into a human, etc. Morphing can create striking special effects, and has 
numerous applications -- from modeling, computer simulation and video games to 
generation of animation sequences for the movie and advertising industries. 

Past advancements in 3D morphing have tended to concentrate on developing 
algorithms for morphing geometry between source and target objects. However, 
modem 3D graphics commonly uses texture mapping to make 3D objects more 
interesting and apparently more complex. Generally, texture mapping involves 
taking a 2D image (e.g., a photographic or other digitized picture) and placing it 
onto a 3D surface. As one example, a brick wall can be imaged by mapping a 
brick-and-mortar texture onto a simple rectangular surface of a 3D "wall" object. 
Images of foliage, clouds, and a variety of other complex images can all be created 
using such texture mapping techniques. 

When attempting to morph a textured 3D image, one must morph the texture 
as well as the geometry. Texture maps can be large, and each texel in the map 



should be morphed to provide a range of interpolated texture values between 
source and target textures. Such texture morphing therefore tends to be 
computationally expensive ~ effectively preventing resource-constrained real-time 
graphics systems such as home video game systems and personal computer 
5 graphics cards from providing real-time texture morphing functionality. What is 
needed is a texture morphing procedure that is fast and efficient enough to be 
performed in real-time within limited resource environments so that texture 
morphing can be performed "on the fly" in a limited resource graphics system. 
The present invention provides a solution to this problem by providing a fast, 

10 ' . real-time texture morphing algorithm that is both fast and efficient. The preferred 
embodiment of the invention provides a number of efficiencies to simplify and 
- reduce the computations required within a texture morphing/b lending process, 
such techniques including off-line texel component decomposition; incremental 
interpolation; frame counters; interlace morphing; and background low-priority 

15 ■-- threading. These techniques can be used individually and/or in combination to 
; " provide morphing procedures fast enough for real-time computer animation and 
simulation and video games. 

In accordance with one aspect of the present invention, incremental 
interpolation techniques are used to reduce repetitive and heavy floating point 

20 number calculations/conversions associated with the typical texel 

blending/morphing process. The preferred embodiment computes an incremental 
morph parameter t for each texel component based on previous value and change 
rate (e.g., image frame rate and the time duration of the morphing process). Initial 
and incremental morph parameter values can be computed in advance for each 

25 texel component during a preliminary morph preparation background process. 
Then, during a subsequent real-time morphing process, these initial and 
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incremental parameter values are applied incrementally to morph the texel 
components toward target texel component values. 

To save floating-to-fixed point conversion time, the preferred embodiment 
uses integer addition to apply the incremental morph parameter values to the texel 
5 component values. However, to preserve accuracy, incremental and new values 
should be floating point numbers. The preferred embodiment resolves this 
inconsistency by using a frame counter concept. The morph parameter 
preparation process determines, for each texel component value, how many image 
frames it will take for a fractional portion of the incremental parameter value to 

10 change the integer portion of the texel component value. The preferred 

embodiment carefully chooses the resulting frame counter values to prevent over- 
runs, and uses them to specify when additional integer correction factors should be 
applied during the incremental interpolation process. To avoid image artifacts due 
to mismatch between the morphed texel component values and the actual target 

15 texel values, the preferred embodiment "snaps" the texel values to the precise 
(floating point) target values during the last morph iteration. 

In accordance with another aspect of the invention, incremental interpolation 
can be applied each frame time or other morphing period to less than all of texels 
being morphed. For example, some texels can be incrementally interpolated 

20 during a particular frame, other texels can be incrementally interpolated during a 
subsequent frame, etc . — so that all texels are incrementally interpolated across a 
certain (preferably small) number of frames without requiring each texel to be 
interpolated every frame. Such interlacing of incremental interpolation can 
significantly reduce computational load without introducing significant image 

25 artifacts. 
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In accordance with yet another aspect of the invention, the texture buffer data 
structure is initially decomposed off-line to reduce the number of real-time 
operations required to separate and manipulate texel component data for 
morphing. The preferred embodiment decomposes the standard texture map into 
5 separate arrays for each of the colors (RGB) and for alpha (transparency). The 
resulting component arrays (which may be 8-bit integer arrays, for example) can 
be manipulated directly by real-time software without additional masking/data 
extraction overhead. 

One significant and advantageous application of the present invention is to 
10 allow dynamic generation of a virtually infinite number of video game characters 
- and other textured objects "on the fly" using morphing procedures within home 
video game systems, personal computer graphics cards, and other inexpensive 
graphics systems. It is possible to pre-construct a number of objects with certain 
geometry and textures as primary sources and targets (" morph terminals"), and 
15_ then use the texture morphing features provided by this invention to smoothly 
transform textures in real time between such objects to generate a sequence of 
, continuous intermediate objects along morphing paths between the morph 
terminals. Since the preferred embodiment stores each set of intermediate 
morphed texture values as a texture map, any such intermediate texture map can 
20 be used as a source texture map for a further texture morphing operation along the 
same or different morph path. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other features and advantages provided by the present invention 
will be better and more completely understood by referring to the following 
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detailed description of preferred embodiments in conjunction with the drawings of 
which: 

Figure 1 shows an overall example 3D graphics system; 

Figure 2 shows an example virtual object morphing space; 

Figure 3 is a flowchart of an example overall texture morphing process 
provided by the present invention; 

Figure 3A shows an example graphics system storage device that stores 
information to control the Figure 1 graphics system to perform the steps shown in 
Figure 3; 

Figure 4 shows example off-line decomposition of a texture map into 
separate component arrays; 

Figures 5 & 5A-5D illustrate an example incremental morphing process; 
Figure 6 shows an example interlacing example; and 

Figure 7 is a flowchart of example steps the preferred embodiment performs 
to provide incremental interlaced texture morphing. 

DETAILED DESCRIPTION OF 
PRESENTLY PREFERRED EXAMPLE EMBODIMENTS 

Figure 1 shows an example real time 3-D computer graphics display system 
50 that may be used to provide realistic interactive real time 3D morphing in 
accordance with the present invention. The Figure 1 example system 50 includes 
a NINTENDO 64® 3-D video game console 52 and associated hand controllers 
54a, 54b. A cartridge 56, optical disk or other storage medium storing a software 
animation (video game) program is operatively connected to console 52. The 
console 52 is connected to a display device 58 such as a conventional home color 
television set or computer monitor. Console 52 includes a 3D graphics engine that 



can render 3D animation on display 58 in real time response to user manipulation 
of controllers 54a, 54b. The software within cartridge 56 controls console 52 to 
display a sequence of animated video frames on display 58. Human players may 
operate hand controllers 54a, 54b to cause, under control of software within game 

5 cartridge 56, game characters to morph interactively in real time. 

Figure 2 shows an example of how intermediate morph objects can be 
dynamically created between three morph terminals 10, 12, 14 using the Figure 1 
system. The objects in circles (obj 1, obj2 and obj3) are intermediate morph 
objects. In this particular Figure 2 example, morphing terminals 10, 12 and 14 

10 comprise a dog, a human and a vehicle, respectively. In this example, any 

morphing terminal 10, 12, 14 can be morphed into any other morphing terminal 
along morphing paths 16. For example, dog morph terminal 10 can be morphed 
into human morph terminal 12 (or vice versa) along morphing path 16a; human 
morph terminal 12 can be morphed into vehicle morph terminal 14 (or vice versa) 

] 5 along morph path 16b; and dog morph terminal 10 can be morphed into vehicle 
morph terminal 14 (or vice versa) along morph path 16c. 

In this example, the morph procedure can be stopped at any point during the 
" procedure (not necessarily at the source or the target), and the intermediate object 
at that point can be used as a new game character with an "in-between" shape and 

20 color. This new object (for example, object "Obj 1 " - a morph hybrid of a dog and 
a human) could be used as a source for yet another morph procedure to ftirther 
morph the object into a ftirther morph "Obj2" ~ and so on. 

More generally, the morph terminals 10, 12, 14 define a virtual object space 
VOS. Any point inside the space VOS represents an intermediate object which 

25 could be rendered as any other pre-constructed object(s) in the simulations. Such 
an ability has the potential of stunning game players by its versatility and 
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unpredictability ~ producing hit video game titles that are interesting and 
enjoyable to play. 

Texture Morphing 

Those skilled in the art understand that there already exist a number of 
efficient algorithms for morphing geometrical data of 3D objects. See, for 
example, Chen et al, "Interactive Shape Metamorphosis", 1995 Symposium on 
Interactive 3D Graphics pp. 43-44 (ACM SIGGRAPH April 1995). However, 
when morphing between the source and target 3D objects, not only the geometry 
(vertices and polygons) of the object, but also the color and texture of the object 
must be transformed from "source form" to "target form"'. Texture morphing has, 
in the past, typically been performed using a computationally intensive brute-force 
heuristic color blending approach. 

A Heuristic Approach 

For example, assume a conventional RGBA 32-bit texture map format and 
further assume that the current morph source, target and intermediate textures are 
stored in array sourceTexture[], targetTexture[] and mediateBuffer[] respectively. 
The brute-force heuristic solution for blending (interpolating) texture components 
can be described by the following pseudo-code for performing a general floating- 
point interpolation function to interpolate between source and target texture maps: 

for (each texel in each texture tile) { 

//decompose source and target texels into R,G,B,A components; 
sourceRed = (sourceTexturefkJ & OxffDOOOOO) » 24; 
sourceGrn = (sourceTexturefkJ & OxOOffOOOO) » 16; 
sourceBlu = (sourceTexturefkJ & OxOOOOffOO) » 8; 
sourceAlp = (sourceTexturefkJ & OxOOOOOOff); 
targetRed = (targetTexturefkJ & OxffOOOOOO) » 24; 
targetGrn = (targetTexturefkJ & OxOOffOOOO) » 16; 



targetBlu = (targetTexturefkJ & OxOOOOffOO) » 8; 
tar get Alp = (targetTexturefkJ & OxOOOOOOff): 
// interpolate the color components 
newRed = (1-t) * sourceRed + t * targetRed: 
5 newGrn = (1-t) * sourceGrn + t * targetGrn: 

newBlu = ( 1-t) * sourceBlu + / * targetBlu; 
new Alp = (1-t) * sourceAlp + t * targetAlp; 
//Assemble the new texel from new components: 

mediateBujfer[k] = (newRed«24)\(newGrn«16)\(newBlu«8)\newAlp; 

10 ; 

where 0.0 <= t <= 1.0 is the morph parameter (i.e., the position of the current 
morph along a morph path 1 6). 

Those skilled in the art will understand that such a brute-force heuristic 
15 approach is straightforward to implement but very computationally expensive ~ 
and is therefore not really feasible for real-time interactive limited resource 
computation environments such as 3D home video game systems. 

A New Texture Morphing Process Provided by the Present Invention 

Figure 3 is a flowchart of an overall process provided by a presently 
20 preferred example process 1 00 of the invention. Process 1 00 is divided into two 
overall stages: an authoring stage 102, and a run-time stage 104. 

During authoring stage 1 02, process 1 00 performs a step 1 06 that 
decomposes texel color information to be morphed into separate RGBA 
component arrays. These separate arrays can be handled at run-time more 
25 efficiently than could a typical unified RGBA texel array. In the preferred 

embodiment, the separate RGBA arrays are stored in cartridge 56, from which 
they can be efficiently read out and copied into the read/write memory of system 
52 for efficient manipulation. 
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During run-time stage 104 (which may, in the preferred embodiment, be 
performed in real time response to interactive inputs provided by user-operated 
controls 54), the preferred embodiment defines initial and incremental morphing 
parameters for the texels to be morphed (block 108). This morphing parameter 
definition step may be performed once per source/target change as a background 
task some time in advance of when morphing must begin (block 108). Then, 
during a run-time morphing step (block 1 10), the preferred embodiment applies 
the incremental morphing parameters to the RGBA texel arrays using integer 
addition to provide incremental interpolation in an interlaced fashion ~ avoiding 
under-runs by "snapping" the texel values to exact target values when (if) the 
morph target is reached. 

Figure 3 A shows the Figure 1 cartridge 56 or other storage medium storing 
software code 56a (e.g., in a read only memory) controlling system 50 to perform 
the Figure 3 texture morphing process. In this example, storage device 56 stores, 
among other things: 

• conventional texture mapping software instructions 56-1, 

• instructions for implementing texel morph precompute step 1 08, 

• instructions for implementing texel morph compute step 1 10; 

• separate texture component arrays as shown in Figure 4; 

• conventional instructions for controlling system 50 to interactively 
respond to user inputs via controllers 54; and 

• conventional instructions for controlling system 50 to display 3D 
textured objects. 



Off-line color decomposition: 

Figure 4 details an example off-line color decomposition step 106. To 

eliminate texel decomposition and new texel assembly at run-time, the preferred 

embodiment reserves and loads one 32-bit texture map block in the static display 

5 list (i.e. textureBufferO) for the intermediate object. Instead of using one 32-bit 

array 120 (a conventional form for texture maps), the preferred embodiment 

decomposes the RGBA texels components of texture map 120 off-line and uses 

resulting separate texel component arrays (e.g., 8-bit arrays 122R, 122G, 122B 

and 122 A for the red, green, blue and alpha texel components, respectively) to 

10 store the texel components. As compared to the heuristic approach discussed 

above, the code that extracts the individual RGBA values from the 32-bit texel 

map can be eliminated, leaving the only the code for color interpolation left in the 

"for" loop as: 

for (each texel in each texture tile) { 

1 5 unsigned char *texel = &textureBuffer[k]; 

texel [RED] = (1-t) * sourceRedfkJ + t * targetRedfkJ; 
texelfGRNJ = (1-t) * sourceGrnfkJ + t * targetGrnfkJ; 
texel [BLU] = (1-t) * sourceBluPcJ + t * targetBlufkJ: 
texelfALPJ = (1-t) * sourceAlpfkJ + t * targetAlpfkJ: 

20 } 

However, the preferred embodiment does not use this form of interpolation, 
but instead uses a faster incremental interpolation process discussed below. 

Incremental interpolation: 

25 To reduce repetitive and heavy floating point number calculations, consider 

how the red component is computed (interpolated) for a particular texel: 
r = (l-t) * SR + t * TR (E.l) 
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where r is the new red component, SR and TR are source and target red 
components respectively, and t is a real number that changes along the morphing 
procedure from 0.0 through 1 .0. If the frame rate (FR) is a constant (say, 30 
frames per second), and the number of seconds (S) within which the morphing has 
5 to finish is given, then the rate of change of t, represented by At, is obtained by 
At=l/(FR*S) (E.2) 
In other words, the value of t can be pre-computed incrementally based on its 
value in the previous time slot and its change rate, i.e. 

t'=t + At. (E.3) 
la Inserting (E.3) to (E. 1) to compute r' (the red component value for the frame 

next to r), we have 

r' = (l-t')*SR + t'*TR (E.4) 
= (1-t-At) * SR + (t+At) * TR 
^ = ri-t^ * SR + 1 * TR + At * (TR-SR^ 

15- =r + Ar 

:: where from (E.2) 

■ - Ar = At * (TR-SR) = (TR-SR) / (FR * S) 

involves only constants (so long as the frame rate is constant) and thus can be pre- 
computed as a uniform increment only once in advance before the morph process 
20 starts. (E.4) states that the texel components can be interpolated through 

incremental addition (i.e., repeatedly adding or subtracting the same uniform 
constant value over and over again), including only one addition (subtraction) 
operation. See Figure 5. 

Notice that from (E.l) we have 
25 r = SR|t=o 
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This gives the initial condition of equation (E.4). 

With this in mind, when given a source and target, the preferred embodiment 
divides the morph procedure into two phases: 

Morphing preparation (Figure 3, block 108) is done only once per 

5 source/target change. This is where the morph parameters (initial and incremental 

values for each texel) are computed. The following is example pseudo-code for 

such a computation: 

numberOfFrames = frameRate * number OfSeconds; 
for(each texel in each texture tile) { 
10 redDlt[k] = (targetRed[k] - sourceRed[k]) / numberOfFrames; 

grnDlt[k] — (targetGrn[k] - soiirceGrn[k]) / numberOfFrames; 

hluDltfk] = (targetBlu[k] - sourceBlufkJ) / numberOfFrames; 

alpDltfkJ = (targetAlp[k] - sourceAlpfkJ) / numberOfFrames; 

newRedfkJ = sourceRedfkJ; 
15'^ newGrnfkJ = sourceGrnfkJ ; 

newBlu[k] = sourceBlu[k] ; 

newAlpfkJ = sourceAlp[k]; 

- } 

Morphing process (Figure 3, block 1 10) is performed each iteration to change 
20 . the value of color components for each texel when the morphing is in progress. In 
the preferred embodiment, only addition operations are used in this step. The 
following is example pseudo-code: 
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for (each texel in each texture tile) { 
newRed[k] += redDlt[k]; 
newGrn[k] += grnDltfkJ; 
newBlufkJ += BluDltfkJ; 
5 newAIpfkJ += AlpDltfkJ; 

unsigned char '^texel = &textureBuffer [k] ; 
texel [RED] = newRedfkJ; 
texel[GRN] = newGrnfkJ; 
texel [BLU] = newBlu[k]; 
10 texel [ALP] = newAlp[k]; 

J 

A problem with the example morphing procedure described above relates to 
its use of integer addition. In order to preserve the accuracy, incremental and new 
. . values (i.e. redDlt[], newRed[], etc.) should be floating point numbers. However, 
15 the 32-bit RGBA texture format defines components (i.e. texel[R£D], texel[GRN], 
texel[BLU] and texel[ALP]) to be 8-bit integers. Thus the last four assignment 
statements in the loop body above imply costly data type conversions. Hence, use 
of integer arithmetic to eliminate floating-point conversions for each incremental 
= interpolation can (depending on the particular platform) significantly speed up the 
20 morphing calculations, but may also result in a loss of accuracy as compared to 
; the use of floating point arithmetic ~ since the intermediate morph values will be 
only integer approximations of the actual value, that would be obtained using 
floating point interpolation techniques. See Figure 5A. To eliminate this hidden , 
cost, the preferred embodiment uses a non-uniform integer correction factor ~ i.e, 
25 it adds an additional integer correction factor (e.g., +1 or -1) during some but not 
all morphing steps ~ with a frame counter selecting when the correction factor 
should be added. 

When preparing morph parameters, the preferred embodiment separates the 
integer part and decimal part of the color delta values (see Figure 5B), and 



computes the number of frames (i.e. redCnt[]) required for the decimal (fractional) 

part to add up to 1. For instance, if the decimal part of the delta value is 0.2, then 

the value of its frame counter should be 5. The following is example pseudo-code: 

for (each texel in each texture tile) { 
5 delta = (targetRedfkJ — sourceRedfkJ) / number OJFrames; 

redlntfkj = floor(delta); 
decimal = delta - redlnt[k]; 
redCntfkJ = (1.0 / decimal) + 0.5; 

10 //do the same to green, blue and alpha components ; 

} 

When morphing texels, the preferred embodiment adds the integer part of an 
incremental value to a texel component in each iteration ~ and adds an extra 1 to 
the value only when the number of iterations is a multiple of N, where N is 
15" specified by its frame counter . See Figure 5. Such further incrementing by a non- 
uniform amount corrects for approximation errors. Notice that all arithmetic 
operations in the iteration involve only 8-bit integers. The following is example 
pseudo-code: 

^ // compute the multiples of current frame numbers. 
20; for(i=l; i< number OfFrames; /++^ { 

frames [i] = (currentFrame%i)? 0: 1; 

} 

currentFrame++; 

II morph texels 

25 for(each texel in each texture tile) { 

TFXELJ/YFE *texel = &textureBuffer[k]; 
texel[RED] += (frames [redCnt[k]])? (redlnt[k]+l): redlnt[kj; 
texel [GRN] += (frames [grnCnt[k]])? (grnlnt[kj+l): grnlntfkj: 
texelfBLUJ += (frames [bluCntfkJ])? (blulnt[k]+ 1): blulntfkj; 
3 0 texel [ALP] + = (frames [alpCntfk]]) ? (alplnt[k]+ 1): alplntfk]; 
} 
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The use of frame counters provides significant improvement in calculation 
speed, but also introduces a potential inaccuracy. Since it is not guaranteed that 
the decimal part of an incremental value can always be added up to exactly 1.0, 
the procedure is prone to "over-run" or "under-run" in certain circumstances, 
5 depending on how the value of a frame counter is calculated. For example, when 
approaching the end of morphing procedure, the texel values of an intermediate 
morph object may exceed that of the target object and create disturbing artifacts. 

To overcome this over-run problem, the preferred embodiment carefully 
chooses frame counters values so they never lead to an "over-run" situation. In 
10 one simple illustration, the frame counter values are rounded down instead of up 
to ensure that the incremental interpolation process yields texel values that do not 
exceed the values they would take on if floating point arithmetic were used.. 

To solve the resulting "under-run" situation, the texel values of the 
intermediate morph object is "snapped" to that of the target object by using a 
5 floating-point operation at the last increment - making the now fully morphed 
: texel values become precisely equal to the target object texel values. See Figure 
5D. The results provided by the preferred embodiment become an approximation 
to those supplied by the heuristic solution after this step. 

Interlace morphing: 

0 To further speed up the morphing process, the preferred embodiment defines 

INTERLACE to be a positive constant integer. When preparing the morph 
parameters, the preferred embodiment multiplies the integer parts of incremental 
values of components by this constant. When morphing textures, the preferred 
embodiment updates the values of texels at a regular intervals specified by 
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INTERLACE. For example, if INTERLACE=3 , then the preferred embodiment 

modifies texels 0, 3, 6, . . . in the first iteration, modifies texels 1, 4, 7, ... in the 

second, do 2, 5, 8, ... in the next, and so forth. Here is example pseudo-code: 

for(i^l; KnumOfFrames; i++) { 
5 frames [i] = (currentFrame%i)? 0: 1; 

} 

for(k=interlace; k<TOTAL_TEXELS; k+ ^INTERLACE) { 

TEXELJYPE *texel = &textureBuffer[k]; 
10 texel[RED] += (frames [redCnt[k]])? (redlnt[k]+ INTERLACE): redlnt[k]: 

texel[GRN] (frames [grnCnt[k]])? (grnlnt[k]+ INTERLACE): grnlntfk]: 
texel[BLU] += (frames [bluCnt[k]])? (blulnt[k]+ INTERLACE): bliilnt[k]; 
texel[ALP] += (frames [alpCnt[k]])? (alplnt[k]+ INTERLACE): alplnt[k]; 

1 5: interlace = + interlace) % INTERLA CE; 

if ([interlace) currentFrame++ ; 

I Figure 6 shows this example interlacing graphically, with one subset of texels 
^ 600a being incrementally interpolated every first of three successive frame times, 
20- a second subset of texels 600b being updated every second of three successive 
frame times, and a third subset of texels 600c being updated every third one of 
three successive frame times. The Figure 6 interlacing morphs all texels every 
three frames, but only needs to morph 1/3 of the texels each frame ~ thus 
significantly reducing computational load. Interlace factors other than 3 (e.g., 2, 
25 4, etc.) can be used. 

Use of Background low-priority thread: 

Although the actually morphing procedure described above may run at a 
satisfactory speed, the procedure of preparing the morph parameters (i.e. 
incremental values and frame counters) is still computationally expensive. In some 
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circumstances, depending on the number of texels in texture tiles to be 
interpolated, it can introduce noticeable delays. To avoid this visual anomaly, the 
morph parameter preparation stage can be sprouted as a task with a lower priority 
running at the background. In the preferred embodiment, the morphing procedure 
5 starts only after receiving a signal from this background task upon its completion. 
This effectively eliminates the frame rate interruptions. 

Example Overall Texture Morphing Process 

Figure 7 is a flowchart of example run-time steps performed by the 
preferred embodiment of this invention. In the preferred embodiment, the process 

10 300 shown in Figure 7 is performed based on software instructions stored within 
cartridge 56. In this example, the Figure 7 morph process 300 begins in response 
to user commands inputted through controls 54 and/or other code stored within 
cartridge 56 (block 306). Such an event causes a main thread 302 to begin 
executing. Main thread, in turn, dynamically sprouts a background thread 304 

15^ (block 308) to perform certain computationally intensive tasks in advance of a 
real-time morphing phase of the process. For example, background thread 304 
(which may be passed the source and target texture maps as well as parameters 
relating to a constant frame rate and the duration of morphing) computes certain 
initial and incremental morph parameter values for each texel component within 

20 the texture map to be morphed (block 3 1 0). In this example process 300, for each 
texel, background thread 304 computes an incremental integer and a frame counter 
value, multiplies the incremental value by an interlace factor, and checks to make 
sure there are no overruns (block 310). 

Meanwhile, main thread 302 performs other computational duties (block 

25 312) and waits until background thread 304 is finished calculating the morph 
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parameters (decision block 3 i4). Once background thread 304 is ready and has 
completed its calculation tasks ("yes" exit to decision block 314), main thread 302 
repetitively performs a morph processing loop comprising blocks 3 16-322. 

Within this processing loop (which may be performed each imaging frame, 
5 i.e., thirty times per second), main thread 302 interpolates each texel component 
within the texture map by adding the uniform incremental value for each 
component (as conditioned on an interlace factor), and may add a non-uniform 
value (e.g., plus or minus one) in certain frames to compensate for approximation 
errors resulting from the integer arithmetic (block 3 1 8). An interlace counter is 

10 incremented to keep track of the interlacing factor vis a vis the current frame, and 
the interlacing factor may be used to select which subset of texels to interpolate 
during a given frame (block 322). This same calculation may be repeated for each 
frame until the last morphed framed approaching the target texture (as tested for 
by decision block 320). Upon reaching the last morphed frame ("yes" exit to 

15 decision block 320), process 300 "snaps" the texel component values to the actual 
target texture values (block 324) — thus avoiding noticeable image artifacts 
resulting from the integer approximation calculations performed by block 3 1 8). 

While the invention has been described in connection with what is presently 
considered to be the most practical and preferred embodiment, it is to be 

20 understood that the invention is not to be limited to the disclosed embodiment. 
For example, although the invention has been described in the context of a 3D 
texture morphing system, it can also find utility in the context of 2D image 
morphing, warping and/or blending. The invention is intended to cover various 
modifications and equivalent arrangements included within the scope of the 

25 appended claims. 
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WE CLAIM : 

1 y A process for morphing a texture comprising: 

2 < determining an incremental morph parameter corresponding to a texel 

3 component, and 

4 in response to said incremental morph parameter, incrementally 

5 interpolating said texel component toward a target texel component state through 

6 at least one intermediate morph texel component state. 

1 2. A process as in claim 1 wherein said incrementally interpolating step 

2 comprises repetitively adding said incremental morph parameter to said texel 

3 component to produce a corresponding sequence of intermediate morph texel 

4 component states. 

1 3. A process as in claim 1 wherein said incrementally interpolating step 

2 comprises using an integer arithmetic calculation to repetitively increment or 

3 decrement said plural texel component based on said determined incremental 

4 morph parameter. 

1 4. A process as in claim 1 wherein said determining step calculates said 

2 incremental morph parameter as the amount of change in said texel component for 

3 each successive time period within a morphing procedure, and said incrementally 

4 interpolating step changes said texel component in response to the integer portion 

5 of said incremental morph parameter. 

1 5. A process as in claim 4 wherein said successive time periods comprise 

2 image frame times. 
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6. A process as in claim 4 wherein said incrementally interpolating step 
conditions said change in said texel component based on which of said successive 
time periods has occurred within said morphing procedure to reduce the number of 
calculations required to morph said textured surface. 

7. A process as in claim 4 further including selectively adding 1 to or 
subtracting 1 from said integer portion to reduce approximation errors in the 
context of integer arithmetic operations. 

8. A process as in claim 1 wherein said incremental interpolation step 
comprises incrementing or decrementing said texel component by integer 
approximations of said determined morph parameter, and compensating for 
approximation errors by performing at least one floating point operation to set said 
texel component to a target texel component value. 

9. A process as in claim 1 wherein said incremental interpolation step 
selectively interpolates said texel component based on an interlace factor. 

10. A process as in claim 1 further including conditioning said incremental 
interpolation step based on an interlace factor. 

1 1. A process as in claim 1 further including calculating a frame counter 
corresponding to said texel component, and selectively incrementing or 
decrementing said texel component in response to said frame counter. 

12. A process as in claim 1 further including the preliminary step of storing 
said texel component in a separate texel component array. 



-1 13. A process as in claim 12 wherein said texel component comprises one 

2 of a red, green or blue color value and an alpha value. 

1 14/ A. system for morphing a textured surface comprising: 

2 //a determiner that determines an incremental morph parameter 

3 corresponding to a texel component, and 

4 an incremental interpolator that incrementally interpolates, in response to 

5 said incremental morph parameter, said texel component toward a target texel 

6 component state through at least one intermediate morph texel component state. 

1 15. A system as in claim 14 wherein said incremental interpolator 

2 repetitively adds said incremental morph parameter to the texel component to 

3 produce a corresponding sequence of intermediate morph texel component states. 

1 16. A system as in claim 14 wherein said incremental interpolator comprises 
an arithmetic calculator that performs a repetitive integer arithmetic calculation to 

3 repetitively increment or decrement said plural texel component based on said 

4 determined incremental morph parameter. 

1 17. A system as in claim 14 wherein said incremental interpolator 



2 calculates said incremental morph parameter as the amount of change in said texel 

3 component for each successive time period within a morphing procedure, and 

4 changes said texel component in response to the integer portion of said 

5 incremental morph parameter. 

1 1 8. A system as in claim 17 wherein said successive time periods comprise 

2 image frame times. 
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1 19. A system as in claim 17 wherein said incremental interpolator 

2 conditions said change in said texel component based on which of said successive 

3 time periods has occurred within said morphing procedure to as to reduce the 

4 number of calculations required to morph said textured surface. 

1 20. A system as in claim 17 further including an adder that selectively adds 

2 or subtracts 1 relative to said integer portion to reduce approximation errors in the 

3 context-of integer arithmetic operations. 

1 21 . A system as in claim 14 wherein said incremental interpolator 

2 increments or decrements said texel component by integer approximations of said 

3 determined morph parameter, and compensates for approximation errors by 

4 performing at least one floating point operation to set said texel component to a 

5 target texel component value. 



1 22. A system as in claim 14 wherein said incremental interpolator 

2 selectively interpolates said texel component based on an interlace factor. 

1 23. A system as in claim 14 further including a conditioner that conditions 

2 said incremental interpolation step based on an interlace factor. 

1 24. A system as in claim 14 further including a frame counter 

2 corresponding to said texel component, and wherein said incremental interpolator 

3 selectively increments or decrements said texel component in response to said 

4 frame counter. 

1 25. A system as in claim 14 further including a separate array storing said 

2 texel component arrays. 
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1 26. A system as in claim 25 wherein said texel component comprises one of 

2 a red, green or blue color value and an alpha value. 

1 27/An efficient 3D morphing process for morphing 3D textured objects 

2 displayed using a real time interactive 3D graphics system including user- 

3 manipulable controls, said system displaying at least one 3D object based at least 

4 in part on a texture map comprising plural texels each comprising plural texel 

5 components, said 3D morphing process including: 

6 (a) calculating incremental morph parameter values for texels of said texture 

7 map; and 

8 (b) in real time, incrementally changing the value of said plural texel 

9 z components over time based on said calculated incremental morph parameter 
10 ~ values. 

1 ; ^ 28. A process as in claim 27 wherein said calculating step (a) comprises 

- calculating the value of Ar = (TC-SC) / (FR * T), where SC is the source texel 

3 " component value, SC is the target texel component value, FR is the frame rate and 

4 " T is the morphing duration. 

1 29. A process as in claim 28 wherein said incrementally changing step 



2 comprises repetitively incrementing or decrementing said plural texel component 

3 values by uniform amounts at a first predetermined frequency based on the integer 

4 portion of Ar, and adding or subtracting a frirther integer value at a further 

5 predetermined frequency less than said first predetermined frequency. 

1 30. A process as in claim 29 wherein said first and second predetermined 

2 frequencies are each based on image frame rate. 
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1^ 3 1 . A process as in claim 29 wherein said second predetermined frequency 

7. is based on a frame counter that counts a predetermined number of image frames. 

1 32: An efficient 3D morphing process for morphing 3D textured objects 

2 displayed using a real time interactive 3D graphics system including user- 

3 manipulable controls, said system displaying at least one 3D object based at least 

4 in part on a texture map comprising plural texels each comprising plural texel 

5 components, said 3D morphing process including: 

6 (a) calculating incremental morph parameter values for said texel 

7 components, including rounding down calculated incremental interpolation values 

8 to the closest integer values to provide integer results and calculating period 

9 counter values based on non-integer remainders of said calculated incremental 

10 interpolation values; 

1 1 (b) at least in partial response to user interaction with said controls, 
changing texel component values at a first periodic frequency based on said 

13 integer results; and 

14 (c) at least in partial response to said period counter, further changing said 
15- texel component values at a second periodic frequency less than said first periodic 
16 frequency to compensate for approximation errors introduced by step (b). 

1 J^I^ ^ real-time interactive graphics system including at least one user- 

2 manipulable control, a process for generating animation objects in real time by 

3 morphing a source texture map including plural texels each having plural 

4 components, into a target texture map including plural texels each having plural 

5 components, said process comprising: 

6 (a) calculating incremental morph parameter values for texels of said first 

7 texture map, and incrementally interpolating the value of said plural texel 



24 



8 components of said first texture map over time based on said calculated uniform 

9 incremental morph parameter values so as to morph said first texture map toward 

10 said second texture map; 

1 1 (b) using an intermediate texture map generated by step (a) to texture map 

12 an animation object; and 

13 (c) controlling at least one of the displayed orientation and position of said 

14 texture-mapped animation object at least in part in response to user manipulation 

15 of said control. 

/ 

1 ZA. A storage device for use with a real-time interactive graphics system 



2 including at least one user-manipulable control, said storage device storing 

3 information used by said system for generating animation objects in real time by 

4 morphing a source texture map including plural texels each having plural 

5 components, into a target texture map including plural texels each having plural 
components, said storage device comprising: 

7 _ a first storage portion that stores information controlling said system to 

8 calculate incremental morph parameter values for texels of said first texture map, 

9 and to incrementally interpolate the value of said plural texel components of said 

10 first texture map over time by uniform integer amounts based on said calculated 

1 1 incremental morph parameter values so as to morph said first texture map through 

12 at least one intermediate texture map toward said second texture map; 



13 a second storage portion that stores information controlling said system to 

14 use said intermediate texture map to texture map an animation object; and 

15 a third storage portion that stores information controlling at least one of the 

16 displayed orientation and position of said texture-mapped animation object at least 

17 in part in response to user manipulation of said control. 
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ABSTRACT OF THE DISCLOSURE 



A fast, texture morphing algorithm for real-time computer simulation 
and video games dynamically generates objects "on the fly" by simplifying 
and reducing the computational load required for a texture 
morphing/blending process. Incremental interpolation techniques compute 
a morph parameter based on previous value and morph change rate. 
Precomputed initial and incremental morph parameter values for each texel 
component are applied during real-time morphing procedures using integer 
arithmetic. Approximation errors are reduced by 

incrementing/decrementing by an extra integer value when the number of 
morph iterations is a multiple of a frame counter. The frame counter avoids 
over-runs, and the morphing procedure is "snapped" the texel value to the 
precise texture target value to prevent under-runs and corresponding 
artifacts. Interlacing (applying interpolation to a subset of the texels each 
frame) significantly reduces computational load without introducing 
significant image artifacts. The morph texture buffer data structure is 
initially decomposed off-line to reduce the number of real-time calculations 
required to manipulate texel component data. 
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Decompose texel color information 
off-line into separate RGBA arrays 



Define initial and incremental morphing parameters once 
per source/target change as a background task 
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During the morphing process, add integer portions of 
incremental morphing parameter to compute new texel 
colors using integer arithmetic in an interlaced fashion, 
avoiding under-runs by "snapping" to exact target values 
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